Performance measures for object detection evaluation

0167-8655/$ see front matter 2009 Elsevier B.V. A doi:10.1016/j.patrec.2009.10.016 * Corresponding author. Tel.: +90 312 2903405; fax E-mail addresses: [email protected] (B. edu.tr (S. Aksoy), [email protected] (S. Eckert), Pesaresi), [email protected] (D. Ehrlich). We propose a new procedure for quantitative evaluation of object detection algorithms. The procedure consists of a matching stage for finding correspondences between reference and output objects, an accuracy score that is sensitive to object shapes as well as boundary and fragmentation errors, and a ranking step for final ordering of the algorithms using multiple performance indicators. The procedure is illustrated on a building detection task where the resulting rankings are consistent with the visual inspection of the detection maps. 2009 Elsevier B.V. All rights reserved.